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Abstract 

The third author noticed in his 1992 PhD Thesis [Sim92] that every regular 
tree language of infinite trees is in a class D{Dn{'^ 2 )) some natural number 
n > 1, where D is the game quantifier. We first give a detailed exposition of 
this result. Next, using an embedding of the Wadge hierarchy of non self-dual 
Borel subsets of the Cantor space 2‘^ into the class A^, and the notions of 
Wadge degree and Veblen function, we argue that this upper bound on the 
topological complexity of regular tree languages is much better than the usual 

keywords: infinite trees; tree automaton; regular tree language; Cantor topology; 
topological complexity; Borel hierarchy; game quantiher; Wadge classes; Wadge 
degrees; universal sets; provably-A^. 


1 Introduction 

A way to study the complexity of languages of inhnite words or inhnite trees 
accepted by various kinds of automata is to study their topological complexity, 
|LT94[ IPPOd^ IGTWn2[ ISta97[ ITho9nl lADMNnTj . In this paper we consider the 
topological complexity of regular languages of trees. 

On one side the topological complexity of deterministic regular languages of 
trees has been determined. Niwinski and Walukiewicz proved that a tree language 
which is accepted by a deterministic Muller tree automaton is either in the class 
Ilg or n}-complete, |NW03j . And the Wadge hierarchy of deterministic regular 
languages of trees has been determined by Murlak, IMurOSt lADMNnTj . 

On the other side in the course of years, more and more complex (non-determinis- 
tic) regular languages of trees have been found. Skurczynski proved that, for every 
natural number n > 1, there are some 11°-complete and some S°-complete regular 
tree languages, |Sku93] . Notice that it is an open question to know whether there 
exist some regular sets of trees which are Borel sets of inhnite rank. Niwinski 
showed that there are some S^-complete regular sets of trees accepted by Biichi tree 
automata, and some IlJ-complete regular sets of trees accepted by deterministic 
Muller tree automata, |Niw85j . Some examples of regular tree languages at some 
transhnite levels of the difference hierarchy of analytic sets were given by Simonnet 
and Finkel in [Sim92l IFS09j . Hummel proved in [Hum! 2] that there exists some 
(unambiguous) regular tree language which is topologically more complex than any 
set in the difference hierarchy of analytic sets. Arnold and Niwinski showed in 
|ANn8j that the game tree languages form a inhnite hierarchy of non Borel 

regular sets of trees with regard to the Wadge reducibility. 
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An upper bound on the complexity of regular languages of trees follows from 
the dehnition of acceptance by non deterministic Muller or Rabin automata and 
from Rabin’s complementation Theorem: every regular set of trees is a A^-set, see 
|Rab691 IFFM ITho9ni ITTm] . 

The third author noticed in his 1992 PhD Thesis |Sim92] that every regular tree 
language of inhnite trees is in a class D(D„(S 2 )) for some natural number n > 1, 
where D is the game quantiher. We hrst give a detailed exposition of this result. 
Next, using an embedding of the Wadge hierarchy of non self-dual Borel subsets of 
the Cantor space 2‘^ into the class A 2 , and the notions of Wadge degree and Veblen 
function, we argue that this upper bound on the topological complexity of regular 
tree languages is much better than the usual A^. 

The paper is organized as follows. In Section 2 we recall the notions of Muller 
tree automaton and regular tree language. The notions of topology are recalled in 
Section 3. We give the upper bound on the complexity of regular tree languages in 
Section 4. We argue that it is a much better upper bound than A 2 in Section 5. 


2 Recognizable tree languages 

We now recall usual notation of formal language theory. 

• In the sequel, E will be a hnite alphabet with at least two letters. A non-empty 
finite word over S is a sequence x = ai ■ ■ ■ ak, where ai E T, for i = 1,..., k, and 
/c > 1 is a natural number. The length of x is fc, and denoted by |a;|. The empty 
word has no letter and is denoted by A; its length is 0. E* is the set of finite 
words (including the empty word) over E. A finitary language over E is a subset 
of E*. 

• The first infinite ordinal is u. An ca-word over E is an ca-sequence ai • • ■ a„ • • •, 
where ai E T, for each natural number z > 1. When a is an cj-word over E, we 
write a = a{l)a{2) ■ ■ ■a(n) • • •, where a{i) E E for each z, a[n] = a{l)a{2) ■ ■ ■cr(rz) 
for each n > 1, and cr[0] = A. The set of ca-words over E is denoted by E*^. An 
CiZ-language over E is a subset of E‘^. 

• The usual concatenation product of two hnite words u and v is denoted by zz-z; (and 
sometimes just uv). This product is extended to the product of a hnite word u and 
an oz-word v: the inhnite word u ■ v is then the ca-word such that: (zz • v){k) = u{k) 
if fc < |zz|, and (zz • v){k) = v{k — |zz|) ii k > |zz|. 

• The prefix relation is denoted by C: a hnite word zz is a prefix of a hnite word 
V (respectively, an inhnite word z;), denoted zz C z;, if and only if there exists a hnite 
word w (respectively, an inhnite word zc), such that v = u ■ w. 
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• We now introduce the languages of infinite binary trees whose nodes are labelled 
in a hnite alphabet S. A node of an inhnite binary tree is represented by a hnite 
word over the alphabet {l,r}, where I means “left” and r means “right”. An inhnite 
binary tree whose nodes are labelled in E is identihed with a function t : {/, r}* —)■ E. 
The set of infinite binary trees labelled in E will be denoted by T^. 

• Let f be a tree. A branch 6 of f is a subset of the set of nodes of t which is linearly 
ordered by the tree partial order C and closed under prehx relation, i.e., if x and y 
are nodes of t such that y & h and x C ?/, then x G 6. A branch 6 of a tree is said to 
be maximal if there is no branch of t containing strictly b. 

Let t be an inhnite binary tree in T^. If 6 is a maximal branch of t, then this 
branch is inhnite. Let (xi)j>o be the enumeration of the nodes in b which is strictly 
increasing for the prehx order. The inhnite sequence of labels of the nodes of such a 
maximal branch b, i.e., f(xo)t(xi) • • ■ t{xn) • • •, is called a path. It is an ca-word over 

E. 


We now dehne tree automata and regular tree languages. 

Definition 2.1 A (nondeterministic topdown) tree automaton is a quadruple 
A = (Q, E, A,go); where Q is a finite set of states, T, is a finite input alphabet, 
go & Q is the initial state and AOQxHxQxQ is the transition relation. The 
tree automaton A is said to he deterministic if the relation A is a functional one, 
i.e., if for each {q,a) E Q x T there is at most one pair of states {q',q'') such that 
(g, a, q', q”) G A. A run of the tree automaton A on an infinite binary tree t E 
is a infinite binary tree p E Tq such that p(A) = go for each x E {l,r}*, 
(p(x), f(x), p(x • /), p(x • r)) G A. 

Definition 2.2 A Muller (nondeterministic topdown) tree automaton is a 5- 
tuple A = (Q, E, A, go, where (Q, E, A,go) is a tree automaton and T C 2^ is 
the collection of designated state sets. A run p of the Muller tree automaton A on 
an infinite binary tree t E is said to be accepting if, for each path p of p, the set 
of states appearing infinitely often in this path is in iF . The tree language L{A) 
accepted by the Muller tree automaton A is the set of infinite binary trees 
t E T^ such that there is (at least) one accepting run of A on t. The class REG of 
regular, or recognizable, tree languages is the class of tree languages accepted by 
some Muller automaton. 


Remark 2.3 A tree language is accepted by a Muller tree automaton iff it is accepted 
by some Rabin tree automaton iff it is accepted by some parity tree automaton. We 
refer for instance to \Tho9(A \ GTW0i^ \PP04\ \ADMN0^ for the definition of Rabin 
tree automaton and of parity tree automaton. 
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3 Topology 


We assume the reader to be familiar with basic notions of topology which may 
be found in [MosOQ! ILT94|. IKec95|. ISta97[ IPPOd] . There is a natural metric on the 
set which is called the prefix metric and dehned as follows. For a, a' G 
and a ^ a' let 5{a,a') = where /pref(o-,o-') is the hrst natural number n 

such that the (n + 1)®* letter of a is different from the (n + 1)^^ letter of a'. This 
metric induces on the usual topology for which open subsets of are of the 
form W , where hF C S*. A set L C is closed if its complement E^ \ L is 
an open set. The topological space E'^ is a Cantor space equipped with the usual 
Cantor topology. 


• There is also a natural topology on the set |Mosn91 ILT941 IKec95] . It is dehned 
by the following distance. Let t and s be two distinct inhnite trees in . Then the 
distance between t and s is A where n is the smallest natural number such that 
t{x) 7 ^ s{x) for some word x G {l,r}* of length n. The open sets are then in the 
form To ■ where Tq is a set of hnite labelled trees. Tq ■ is the set of inhnite 
binary trees which extend some hnite labelled binary tree to E Tq, to is here a sort 
of prehx, an “initial subtree” of a tree in to ■ T^. It is well known that the set , 
equipped with this topology, is homeomorphic to the Cantor space 2“', hence also to 
the topological spaces E^^, where E is hnite. 


• We now dehne the Borel Hierarchy of subsets of E^^. It is dehned similarly on the 
space T^. 

Definition 3.1 For a countable ordinal ^ > 1, the classes and 11^ of the Borel 
Hierarchy on the topological space TF are defined as follows: 

is the class of open subsets ofTF, 
n? is the class of closed subsets o/E'^, 
and, for any countable ordinal ^>2, 

is the class of countable unions of subsets of E'^ in u,<« n;, 
n? is the class of countable intersections of subsets o/E^" in 

For a countable ordinal a subset of E“^ is a Borel set of rank ^ if it is in S^UH^ 
but not in U n°). 

• There exists another hierarchy beyond the Borel hierarchy, which is called the 
projective hierarchy. The classes and of the projective hierarchy, dehned 
for natural numbers n > 1, are obtained from the Borel hierarchy by successive 
applications of the operations of projection and complementation. The hrst level of 
the projective hierarchy is formed by the class Sj of analytic sets and the class Hj 
of co-analytic sets, which are the complements of analytic sets. 
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In particular, the class of Borel subsets of is strictly contained in the class of 
analytic sets, which are obtained by projection of Borel sets. 

Definition 3.2 A subset A o/E‘^ is analytic if there is a Borel subset B o/(Ex2)‘^, 
where 2 = {0,1}, such that a E A ^ ^6 E 2^ with (ex, 6^) E B, where (a, 6^) is the 
infinite word over the alphabet E x2 such that (cr, 9){i) = (cx(f), 9{i)) for each natural 
number i > 1. 

Remark 3.3 In the above definition we could take B in the class IMosOflj . 

The Borel hierarchy and the projective hierarchy on are defined from open 
sets in the same manner as in the case of the topological space E'^. 

• The notion of Wadge reducibility is defined via the reduction by continuous func¬ 
tions. In the sequel, 0 will be a finite alphabet with at least two letters. For L 

and V C 0^, L is said to be Wadge reducible to L', denoted by L <w L', if there 
exists a continuous function / : E^^ —)■ 0“^, such that L = f~^{L'). If ^ > 1 is a 
countable ordinal and n > 1 is a natural number, then a set F C E'^ is said to be 
(respectively, 11°, Il^'^j-complete if, for any set E C 0^^, F G (respectively, 

F e n°, F e El, F G ) iff e <w e. 

The cj-language TZ = (0* • 1)^ is a well known example of a Il^-complete subset 
of {0,1}^^. It is the set of cj-words over {0,1} having inhnitely many occurrences of 
the letter 1. Its complement {0,1}^^ \ (0* ■ 1)‘^ is a S^-complete subset of {0,1}^^. 
The set of inhnite trees in , where E = {0,1}, having at least one path in the 
cn-language H is S|-complete. 

• We now dehne the difference hierarchy over a class F. Let n be a natural num¬ 

ber, and {Ap)p^n be an increasing sequence of subsets of some space Z. The set 
Dn[{Ap)p^ri\ is the set of elements zE Z such that z G ^p\Ug<p some p<n 

whose parity is opposite to that of n. We can now define the class of n-differences 
of F-subsets of Z, where Z = or Z = T^: 

-Dn(r) := {-Dn[(^p)p<n] | Ap is in the class F for each p < n}. 

It is well known that, for every countable ordinal ^ > 1, the hierarchy of differences 
of S^-sets is strict, i.e., the inclusion Fm(S°) C F„(S^) holds if m < n. 

Notice that the difference hierarchy has an extension to countable ordinal ranks, 
see for instance [MosOQl IKec95] , but we shall not need this in the sequel. 

Moreover, every regular cn-language is a boolean combination of S^-sets, and 
belongs to some class ^^(S^), for some natural number n > 1. We shall also 
consider these classes f^e sequel. 
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It is also well known that the hierarchy of differences of analytic sets is strict. It 
was proved by Hnmmel in [Hnml 2] that there exists some (nnambiguons) regnlar 
tree langnage which is topologically more complex than any set in the difference 
hierarchy of analytic sets becanse there exists some (nnambignous) regnlar tree 
language which does not belong to the cr-algebra generated by the analytic sets. 


4 An Upper Bound 


We hrst recall the dehnition of Gale-Stewart games. 


Definition 4.1 f |Kec95] i Let A C S‘^. The Gale-Stewart game G{A) is a game 
with perfect information between two players. Player 1 first writes a letter Oi G S, 
then Player 2 writes a letter bi E then Player 1 writes 02 G S, and so on ... 
After u! steps, the two players have composed a word a = aibia 2 b 2 ... ofTP. Player 
1 wins the play iff a E A, otherwise Player 2 wins the play. 


Let A TP and G{A) be the associated Gale-Stewart game. A strategy for 
Player 1 is a function Fi : (S^)* —>■ T and a strategy for Player 2 is a function 
F 2 : (S^)*E T. Player 1 follows the strategy Fi in a play if for each natural 
number n >1 On = .^i(ai&ia 2^2 • • • If Player 1 wins every play in 

which she has followed the strategy Fi, then we say that the strategy Fi is a winning 
strategy (w.s.) for Player 1. The notion of winning strategy for Player 2 is defined 
in a similar manner. 


The game G{A) is said to be determined if one of the two players has a winning 
strategy. 


We now recall the definition of the game quantifier. 

Definition 4.2 f |Mos09j i (1) If P <ET‘^ x 2‘^, then we define 

DP:=|(TGE‘^ I Player 1 has a winning strategy in the game G{P„)} 
where P^^ = {a e 2‘^ \ (a, a) EP}. 

(2) If T is a class of sets and LFT^, then LeDT if and only if there is PFT'^x2^ 
in r such that L = DP. 


Note that one can replace with the homeomorphic space Tf in this definition, 
replacing also P with a T-subset of Tf x 2^. We obtain like this the definition of 
subsets of Tf in the class D(r). Note that we consider the alphabet 2 = {0,1} and 
not the finite alphabets with at least two letters T in order to avoid troubles in the 
proof of Proposition 15.81 to come. This leads us to prove the following lemma. 
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Lemma 4.3 We can find a continuous injection and an open subset O 

of2‘^ such that, for each subset A ofT,‘^, the set A' ■ = Lp[A\UO satisfies the following 
property: Player 1 has a winning strategy in the game G{A) if and only if Player 1 
has a winning strategy in the game G{A'). 

Proof. The proof is similar to that of Lemma 3.14 in |Finl3b] . We may assume that 
E is a natural number and with a usual convention that E = {0,1,..., E — 1}. Let 
ip\TP ^2^ be dehned by </ 9 (aia 2 ...) := Note that (p is a continuous 

injection. We set Di\ = Lp[A\, so that Di codes A. We also set 

L)2:={ae2‘^ I 3ai,...,a2neE 3fc<E-l (ll)“i0...(ll)“2-0l2^+^0Co}, 

D^: = {ae2‘^ \ 3ai,..., aan+i eE (Il)“i0...(ll)“2-+i0l2s-i Co}. 

As D 2 and Ha are open, 0 :=i 32 U is open too. The sets D 2 ,D^ are the results 
of inhnite plays where two players alternatively write a letter 0 or 1 and the inhnite 
word written by the two players in uj steps is out of K :=(p[E‘^], due to the letters 
written by Player 2. More precisely, D 2 is the set of plays where Player 2 writes the 
( 2 ? 7 ,+l)th letter 0 while it was Player I’s turn to do this. And is the set of plays 
where Player 2 does not write a letter 0 soon enough when it is his turn to do this. 

If now the two players write alternatively a letter 0 or 1 in such a way that the 
inhnite word written by them in uj steps is in K and of the form (ll)“i0(ll)“^0..., 
then the letters 0 have been written alternatively by Player 1 and by Player 2, and 
these letters 0 determine the natural numbers a*. Thus the natural numbers 02 *+! 
have been chosen by Player 1, and the natural numbers 021+2 have been chosen by 
Player 2 (for iEuj). 

If Player 1 has a winning strategy s in the game G{A), then consider a play 
in the game G{A'). If the two players alternatively write a letter 0 or 1 and the 
inhnite word a written by them in u steps is in K and of the form (ll)“i0(ll)“2 0..., 
then the game is like a game where each player writes a letter in E at each step of 
the play, and Player 1 can apply s to ensure that (aj)j>i G A, which implies that 
p(((^i)i>i) ^ Pi ^ A', so Player 1 wins the play. If a is out of K due to the letters 
written by Player 2, then a G 132 U C and Player 1 wins the play again. This 
shows that Player 1 has a winning strategy in G(A'). 

If Player 1 has a winning strategy s' in the game G(A'), then consider a play in 
the game G(A) where Player 2 does not make the hnal word a in ^2 U -D 3 . Player 
1, following s', must write letters so that the hnal word a belongs to K. Then 
the game is reduced to the game G(A) in which the two players alternatively write 
letters a* in E. But Player 1 wins the game and this implies that Player 1 has a 
winning strategy in G(A). □ 

We now give the upper bound on the complexity of regular tree languages. 




Theorem 4.4 Let A be a Muller tree automaton. Then the tree language L{A) is 
in the class D(D„(S 2 )), for some natural number n > 1. 

Proof. Let A = {Q, S, A, qq, if) be a Muller tree automaton, where {Q, S, A, go) is 
a tree automaton and C 2*5 is the collection of designated state sets. 

The idea is to use a game which was considered by Gurevich and Harrington 
in |GH82j . For t G we consider the Gale-Stewart game G{Tt), where the set 
Tj C (A U {l,r})‘^ is dehned as follows. Intuitively, in the game G{Tt), Player 1 
writes transitions of the automaton A, i.e., letters of A, and Player 2 writes letters 

1 or r, so that at the end of a play he has actually composed a path in the tree t. 

At the hrst step. Player 1 chooses a transition {qoAWAyQ') ^ Next, Player 

2 chooses / or r. If Player 2 chooses I this means he has chosen the left son of 
the root node of the tree and thus Player 1 has to choose a transition of the form 
{q, t{l), q", q'"). If Player 2 chooses r this means he has chosen the right son of 
the root node of the tree and thus Player 1 has to choose a transition of the form 
{q', t{r), q", q'"). The game continues like this and Player 1 wins this game if the set 
of states (played by Player 1) which appear inhnitely often on the path chosen by 
Player 2 belongs to if. 

Formally, if a G 0*^, then we dehne (a)i, ( 0)2 G 0*^ by (a)i(/c) := a{2k — 1) and 
{a) 2 {k) :=a{2k). Tt is the union of |a G (A U {/, r})*^ | 3k >1 ( 0 ) 2 (fc) ^{l,r}^ with 

|aG (A U {l,r})‘^ I \/k>l ^(Q;)i(fc) G A and {a) 2 {k) G{/,r} and a(l)(l) = go 

and (a).(fc)(2)=(((a)j|fc-l|) and (a),(fc + 1)(1) = | ) 

and {gGQ I Vj Go; 3m>j (a)i(m)(l) = g} G 

By dehnition of the Muller acceptance condition for the tree automaton A, 

t G L{A) -v^ Player 1 has a winning strategy in the game G(Tt). 

Indeed, if t G L{A), then there is a witness p E Tq and we can dehne a strategy 
p for Player 1 by p[x) := {p{x),t{x), p{xl), p{xr)), and p is winning for Player 1. 
Gonversely, if p is a winning strategy for Player 1, then the formula p{x) :=p{x){l) 
dehnes a witness for the fact that t G L{A). 

We apply Lemma [4.31 to the hnite alphabet A U {l,r}, which gives a continuous 
injection (p: (A U {/, >-2*^ and an open subset O of 2*^. Then we set 

P ;= {(t, a) G X 2*" I a G ip[Tp U O}, 

so that t G L{A) <S4> Player 1 has a winning strategy in the game G{Pt) ^ tEDP. 
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It remains to see that P is in for some natural number n > 1. If 

B : = Dn[{Ap)p^n\ is in and (7 is a closed set, then B H C = Dn[{Ap O C)p^n\ 

is also in If U is an open set, then B UU = Dn[{ApUU)pcn] if n is odd, and 

Bull = Dn[{AQ\U, AiUU,An-iUU)] if n is even, so that BUU is also in 
This shows that the class is closed under intersections with a closed set and 

unions with an open set. As it is also closed under images by homeomorphisms 
and (p is a homeomorphism onto its compact range, it is enough to show that T 
is in Dni'S^) for some natural number n > 1. This is known to be equivalent to 
the statement “T is a boolean combination of follows from the 

dehnition of the Muller acceptance condition of the tree automaton A. Indeed, 

- the condition “3A:>1 (a) 2 (fc) ^ {Z, r}” is open, 

- the condition involving k and the big parentheses in the dehnition of Tt is 
closed, 

- the condition involving P says that there is F in the hnite set P such that, for 

each q in the hnite set Q, either qEF and VjGo; 3m>j {a)i{m){l) = q (this is a 
112 condition), or q^F and SjGo; \/m>j {a)i{m){l) j^q (this is a S 2 condition). 
This hnishes the proof. □ 


5 The Upper Bound is much better than A 2 


In this section, we are going to show that the upper bound given in the preceding 
section is actually much better than the usual one, A^. 


• We hrst dehne the Wadge hierarchy, which is a great rehnement of the Borel 
hierarchy, and is dehned via reductions by continuous functions, |Dup01[ IWad83] . 


Definition 5.1 (Wadge |Wad83] I Let L FTP and L' C 0‘^. ITe say that L and 
L' are Wadge equivalent if L <\y L' and L' <\y L. This will be denoted by 
L =\Y L'. We shall also say that L <iy L' iff L <iy L' and L' L. We say that 
L is self dual if L =yy -<L (-<L is the complement of L), otherwise we say that L 

is non self dual. 


The relation <w is rehexive and transitive, and =w is an equivalence relation. 
The equivalence classes of =w are called Wadge degrees. The Wadge hierarchy 
WH is the class of Borel subsets of a space 2“^, equipped with <w and =w For 
L FTP and L' C 0^, if L <iy L' and L = f~^{L'), where / is a continuous function 
from T^ into 0“^, then / is called a continuous reduction of L to L'. Intuitively, it 
means that L is less complicated than L', because in order to check whether a E L, 
it suffices to check whether f{a) G L' (where f is a continuous function). Hence the 
Wadge degree of an cj-language is a measure of its topological complexity. 
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Note that in the above dehnition, we consider that a subset L C is given 
together with the alphabet E. This is important as it is shown by the following 
simple example. Let Li = {0,C {0, and L 2 = {0,C {0,1,2}^. So the 
languages Li and L 2 are equal but considered over the different alphabets Ei = {0,1} 
and E 2 = {0,1,2}. It turns out that Li <w L 2 . In fact Li is open and closed in 
E}” while L 2 is closed but not open in E 2 . 

We can now define the Wadge class of a set L. 


Definition 5.2 Let L be a subset o/E^^. The Wadge class of L is 

[L] = {L' I L' C for a finite alphabet 0 and L' <w L}. 

Recall that each Borel class and 11° is a Wadge class. It follows from the 
study of the Wadge hierarchy that a set L C X‘^ is S° (respectively, n°)-complete 
iff it is in S° but not in 11° (respectively, in 11° but not in S°). 

Using the notion of a Wadge game, and the fact that the determinacy of Wadge 
games follows from Martin’s Theorem stating that every Gale-Stewart Game G{B), 
with B a Borel set, is determined, see |Kec95j . Wadge proved the following result. 

Theorem 5.3 (Wadge) Up to complement and =w, the class of Borel subsets of 
the spaces E^^ is a well ordered hierarchy. We can find an ordinal \ WH\, called the 
length of the hierarchy, and a map d^ from WH onto \WH\ \ {0}, such that, for 
all L, L' C E*^, 

- d°^L < ^L<w L', 

- d^wL = d^^L' ^ [L =w L' or L =w -T']. 


• Let bJi be the first uncountable ordinal. The Wadge hierarchy of Borel sets 
of hnite rank has length where ^£0 is the limit of the ordinals defined by 
oi = uji and On+i = if n is a natural number. Then is the first fixed point 
of the ordinal exponentiation of base ui. The length of the Wadge hierarchy of 
Borel sets in A° = S° fl 11° is the hxed point of the ordinal exponentiation of 
base cji, which is a much larger ordinal. The length of the whole Wadge hierarchy is 
described in |Wad83[ |Dup01| , and uses the Veblen functions. To recall the definition 
of these functions, we need the notion of cohnality of an ordinal which may be found 
in |,Tecn2] and which we briefly recall now. 


Definition 5.4 Let C, be a limit ordinal. The cofinality of C,, denoted by cof{(), 
is the least ordinal fi such that there exists a strictly increasing seguence of ordinals 
{Ci)i</3! of length fi, such that sup^^^O = C, and Q < ( for each i < (3. This 
definition is usually extended to 0 and to the successor ordinals: co/(0) = 0 and 
co/(C + 1) = 1 for every ordinal (. 
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The cofinality of a limit ordinal is always a limit ordinal with u < cof{() < (. 
The ordinal cof{() is in fact a cardinal (see |Jec02j h If the cofinality of a limit ordinal 
C is < cni, then only the following cases may happen: cof{Q = w or cof{Q = uji. 
In the seqnel we do not need to consider cofinalities which are larger than uji. In 
the seqnel, u :2 willl be the first ordinal of cardinality greater than Mi, the cardinal 
of bJi- Note that each ordinal C < a ;2 has cofinality smaller than or eqnal to uji. 

Definition 5.5 The Veblen hierarchy of functions from uj 2 \ {0} into 

itself is defined as follows. Vq is the function that enumerates ordinals of cofinality 
oji or 1 that are closed under ordinal addition, i.e., Vo(l) = 1, Vo((C + l) = Vo(C)-n;i, 
Vo(C) = 1^1 when cof{() = ui, Vo(C) = when cof{Cf) = u. For .^ > 0, is the 
function that enumerates ordinals of cofinality oji or 1 that are closed under each 
function 14 ? for any rj < ^. 

We can now describe the length of the whole Wadge hierarchy of Borel sets on a 
Cantor space or . It is the ordinal snp^^^^ ^(2)- This is really a hnge ordinal, 
with regard to the uj\^ fixed point of the ordinal exponentiation of base uji, which is 
the length of the Wadge hierarchy of Borel sets in A°. 

• We now recall the notion of a nniversal set which will be nsefnl in the seqnel. 

Definition 5.6 Let T be a class of sets. We say that U xTF is universal for 
the r subsets ofTF ifU is in F, and for each in F there is /9g2‘^ such that 

A is the vertical section Uy\ = {a \ (/3,a)GW} ofU at f. 

The following resnlt is mentioned in [LSR 88 ] . 

Theorem 5.7 Let F be the Wadge class of a non self-dual Borel subset of2^. Then 
there is a universal set for the F subsets of E^^. 

Proof. Let A,B<T2^. We consider the Wadge game G{A,B) associated with A 
and B. It is the Gale-Stewart game defined by 

Player 2 wins the play {aia 2 ...EA bib 2 ...EB). 

If s is a strategy for Player 2 and a G 2‘^, then we denote by s^a the element 
6162 -•• of 2^ given by the answers of Player 2 in the play where Player 1 plays 
a\ = aia 2 ... and Player 2 follows s. Formally, (s*q;)(1) : = 6 i :=s(ai) and, indnctively, 
{s*a){k) :=bk.= s{aibia 2 ...bk-iak) if k>2. Notice that a strategy s for Player 2 is 
an element of 2 ^^ As ( 2^)*2 is conntable, we can identify 2 ^^ with the Cantor 
space 2^. Note that the map e: (s, a) is continuous from 2^^ 1*^x2^ into 2^. 
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Theorem 2.7 and Remark 4 after the proof of Theorem 3.1 in |LSR88j provide a 
subset L of 2^^ in F such that Player 2 has a winning strategy in the game G{A, L) 
for each subset A of 2‘^ in F. We set V := {(s, a) G 2*^^^^*^ x 2“ | s=t:a G L}. As e 
is continuous, V is in F. If A C 2'^ is in F, then Player 2 wins the Wadge game 
(^(A, L), which gives s in 2^^ such that A = Vs- This shows that we can consider 

V as universal for the F subsets of 2‘^, up to identification. 

Let E be a finite alphabet, and -0 : —>■ 2^^ be a homeomorphism. We set 
7/:=(Id 2 <^ X'0)“^(V), and it is routine to check that U is universal for the F subsets 
of □ 

Proposition 5.8 Let T be a class of sets. If there is a universal for the F subsets 
of x2‘^ , then there is a universal for the DF subsets o/S'^. 

Proof. Let W be a universal for the F subsets of x2^. We set V := DU. Then 

V C 2*^ X E‘^ is in DF. Let A C E‘^ be in DF, and PC E^^ x 2^^ in F such that A = DP. 

Then there is /9 g 2‘^ with P=Up. It remains to note that A = Vp. □ 

Corollary 5.9 Let F be the Wadge class of a non self-dual Borel subset o/2“. Then 
there is a universal for the DF subsets ofE‘^. 

Proof. Theorem 15.71 gives a universal for the F subsets of E‘^x2^, and Proposition 
15.81 gives the result. □ 

• We now turn to the key result of embeddability of the Wadge hierarchy into that 
obtained with the game quantiher. 

Lemma 5.10 Let T be a class of sets closed under continuous pre-images. Then 
DT is also closed under continuous pre-images. 

Proof. Let L C E‘^ in DF, P C E^^ x 2^^ in F such that L = DP, and / : —)■ E*^ be 

continuous. As F is closed under continuous pre-images, the set 

Q: = {(5,a)G0"x2-|(/(h),a)GP} 

is in F. Note that, for each hG©^, 

5ef-\L)^f{5)eDP 

Player 1 has a winning strategy in the game 

G({aG2-|(/(5),a)GP}) 
Player 1 has a winning strategy in the game G({aG2‘^|((5, a) gQ}) 
6eDQ. 

Thus /-i (L) C Q‘^ is in DF. □ 
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Corollary 5.11 The map Fi—)-Dr, defined on the collection of Wadge classes of a 
non self-dual Borel subset of 2‘^, is strictly increasing for the inclusion. 

Proof. Let L, L' be non self-dual Borel subsets of 2“, and F, F' be the Wadge classes 
of L, L' respectively. We assume that F^F', so that L <\y L'. By Wadge’s lemma, 
-iL <w L', so that F and F := {-<A \ A G r} are contained in F' (see 21.14 in 
[Kec95]). This implies that DFCDF', and in fact DF U DFCDF'. 

Assume, towards a contradiction, that DF = DF'. Corollary 15.91 gives a universal 
U for the DF' subsets of 2‘^. We set A\={aE2‘^ \ {a, a) As U is in DF', it is 
also in DF. This gives PC (2'^)^ in F with U = DP. As L is Borel, 20.5 in [Kec95] 
implies that 

-i(Player 1 has a winning strategy in G({ae2‘^ | (/3, 7 , a) gP})) 
Player 2 has a winning strategy in G({aG2‘^ | (/3, 7 , a) ^P}). 

By 6D.1 in [Mos09], -iW gDF CDF'. As the map {a, a) is continuous, AgDF', 
by Lemma l5.ini This gives such that A=LAy. Thus 

(/9,/9)gW /5gA { 13 , 13 ) 


which is absurd. □ 

Lemma 5.12 Let T be a class of Borel sets. Then DF is contained in A^. 

Proof. Let L flTA be in DF, and P C x 2“^ be in F such that L = DP. If a, r 
are strategies for Players 1 and 2 respectively, then we denote by cr * r the element 
of 2^ obtained when Player 1 follows a and Player 2 follows r. As P is Borel, 
Pg := {a G 2^^ | {fi, a) G P} is Borel for each (3 G TP. By 20.5 in [Kec95], the game 
defined by Pg is determined. This implies that /9 G L iff 

BgDP-x^ Player 1 has a winning strategy in the game G({aG 2 ‘^ I {B,a) eP}) 

Vr {(3,a * t)eP 3a (/?,a*r)GP. 

Thus LGA 2 . □ 

The classes DniT^) appearing in Theorem 14.41 are contained in S 3 , which is a 
small part of the class of Borel sets. By Theorem 14.41 and Corollary 15.111 the tree 
languages of Muller tree automata are in the class DSg. By 22.4 in [Kec95], the 
sequence is strictly increasing for the inclusion. By Corollary 15.Ill the 

sequence (DS^)g<t^;j is also strictly increasing for the inclusion. By Lemma [5.121 the 
elements of the latter sequence are contained in the class A^. This shows already 
that the increasing sequence (D(P„(S 2 )))„>^ is only a small part of the hierarchy 
of A 2 sets. 
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This is actually emphasized by considering the Wadge hierarchy of non self-dual 
Borel subsets of 2^. By Corollary 15.111 we know that this hierarchy can be embedded 
into a hierarchy of classes DT, included into A^. On the other hand the Borel class 
S 2 is known to be a non self-dual Wadge class and the Wadge degree (in the sense 
of Theorem I5.3p of any S^'Complete set is equal to uji. Moreover, for each natural 
number n > 1, the class is also a non self-dual Wadge class and the Wadge 

degree of any Zi)„(S 2 )-complete is equal to {oJiY, |Wad831 |Dup01| . Therefore, we 
see that this ordinal is actually much smaller than the hrst hxed point of the ordinal 
exponentiation of base ui (the length of the Wadge hierarchy of Borel sets of hnite 
ranks), than the hxed point of the ordinal exponentiation of base ui (the length 
of the Wadge hierarchy of Borel sets in A°), and a fortiori than the ordinal 


sup 14 ( 2 ), 

which is the length of the Wadge hierarchy of (non self-dual) Borel subsets of the 
Baire space or the Cantor space. In conclusion the upper bound we gave is much 
smaller than A 2 , as summarized in the following theorem. 


Theorem 5.13 The hierarchy of classes DT, for non self-dual Borel Wadge classes 
r of 2^, is a hierarchy of length sup^^^^ ^(2) included in the class while the 
regular tree languages are contained in the first (a;!)^^ levels of this hierarchy. 

• We also note that regular tree languages are in the class provably-A^ (see |Kan97i 
page 180]). This is essentially proved in |HKMNn^ from Rabin’s Theorem |Rab69j . 
Thus all regular tree languages have the Baire property (see |Kan97i page 180]). 
This gives an answer to a question of the third author in |Sim92j . 

As noticed by the referee of this paper, this also follows from |GMMSi4] . since 
all R-sets are Baire-measurable as well as Lebesgue measurable and it is proved in 
jCMMSll] that regular tree languages are R-sets. 


6 Concluding remarks 

We gave an upper bound on the topological complexity of recognizable tree 
languages and showed, using an embedding of the Wadge hierarchy of non self-dual 
Borel sets of 2^^, that this upper bound is actually much smaller than A^. 

The anonymous referee of this paper indicated us that since the first appearance 
in 1992 of the above Theorem 14.41 in the PhD Thesis of the third author of this 
paper, quite a few authors made various observations in a few papers that we now 
mention. 
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In J. Bradfield’s paper |Bra03j . and in |BDQ05| by J. Bradfield, J. Duparc and 
S. Quicker!, a link between the game quantifier and the /i-calculus is described, 
and Corollary 11 of |Bran3] explicitely states an upper bound in a style similar to 
the one presented in our paper. In |MN12] . D. Niwinski and H. Michalewski are 
also interested in the problem of finding upper bounds for the class of regular tree 
languages. Using a method developed by J. Saint Raymond in |SR06j . they prove 
that the game tree language is complete for the class of S}-inductive sets. 
The Sj-inductive sets are known to contain more complex sets than the a-algebra 
generated by the analytic sets. Moreover, the referee indicated us that one can 
actually verify that the language given in S. Hummel’s paper |Hnml2] is reducible 
to fUi 3 and is not complete for the class of S}-inductive sets. In another recent 
paper |GMMS14] T. Gogacz, H. Michalewski, M. Mio and M. Skrzypczak show a 
one-to-one correspondence between the levels of the hierarchy of Kolmogorov R-sets 
and parity index of regular languages which extends the theorem from |MN12] . Since 
due to a theorem of Burgess the R-sets are known to be in correspondence with the 
game quantifier, on a technical level this covers Theorem 14.41 We also notice that 
another estimation of the kind of Theorem 15.131 is present in |GMMS1~4] . where it 
is shown that regular languages of infnite trees occupy exactly the first cn-levels of 
Kolmogorov’s hierarchy; and on the other hand it is known that there exist Ui levels 
in this hierarchy, all of them contained in the class A^. Theorem 15.131 mav then be 
seen as a generalization of the estimation following from |GMMS1~4] . 

We now state some important open questions. 

• A difficult problem in the study of the topological complexity of recognizable tree 
languages is to determine the Wadge hierarchy of tree languages accepted by non 
deterministic Muller or Rabin tree automata. A subquestion is to know whether 
there is a regular language of infinite trees which is a Borel set of infinite rank. 

• A related problem is to study the determinacy of Wadge games between tree 
automata; this would be a first step towards the possibility of using these games to 
determine the topological complexity of a regular tree language. Note that in the 
case of one-counter Biichi automata it has been shown that the determinacy of such 
games needs some large cardinal assumption (see |Finl3aj ). 

We now state some important open questions which are more related to the com¬ 
puter science roots of regular languages since they also involve decidability questions. 

• While many questions about deterministic regular languages of infinite trees have 
been shown to be decidable [AOMNOT] . many corresponding questions about non- 
deterministic regular languages of infinite trees are still open. 
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Concerning the decidability of the topological complexity of regular languages, 
it has been shown recently by M. Bojanczyk and T. Place in [BP12j that one can 
decide whether a regular language accepted by a given tree automaton is a boolean 
combination of open sets. This result has been extended by A. Facchini and H. 
Michalewski in |FM14] . where the authors prove that one can decide whether a 
regular tree language is in the class Ag. The question is still open for the other 
levels of the Borel hierarchy, or whether a regular tree language is Borel, analytic, 
coanalytic, or in any class DF present in this paper. 

Acknowledgement. We wish to thank the anonymous referee for very useful 
comments on a preliminary version of this paper which lead to a great improvement 
of the paper, and for indicating us some related studies that are now present in the 
bibliography. 
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